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A  PROBABILISTIC  /  POSSIBILISTIC  APPROACH  TO  MODELING  C3  SYSTEMS:  PART  II 

I . R  .  Goodma n 

,  '  Command  &  Control  Department 

\  Code  421 

NAVAL  OCEAN  SYSTEMS  CENTER 

San  Diego,  California  92152 


ABSTRACT 

This  paper  continues  the  work  begun  in  the 
last  Proceedings  (9th  MIT/ONR  Workshop  on  C3  Sys¬ 
tems).  In  that  work,  C3  systems  are  considered  as 
Interacting  networks  of  decision-making  node  com¬ 
plexes  characterized  by  system  or  process  variables. 
Internodal  relations  are  modeled  through  nonlinear 
additive  (in  the  genera' sense)  regression  relations! 
intranodal  relations  are  made  to  follow  a  general 
SHOR  (Sense-Hypothesize-Option-Response)  paradigm. 

In  turn,  it  is  shown  that  a  collection  of  ten  types 
of  relatively  primitive  Implication  or  conditional 
relations  PRIM  between  C3  variables  for  enemy  and 
friendly  component  systems  determines  all  updated 
marginal  node  state  distributions.  (Distributions 
can  be  In  the  classical  probabil isitic  sense  or 
more  generally  1n*a  multi-valued  logical  sense.) 

This  leaas  to  a  C3  decision  game,  where  the  loss 
function  is  some  picked  combination  of  measures  of 
performance  or  effectiveness  derived  from  node 
states  and  where  each  decision  strategy  corresponds 
to  some  choice  of  PRIM  for  each  C3  system. 

In  the  present  work,  emphasis  Is  placed  upon 
model  refinement.  In  particular,  the  Intranodal  re¬ 
lation  representing  data  fusion  Is  expanded  and 
analyzed.  This  expansion  Is  characterized  by  a 
weighted  sum  of  products  for  the  classical  proba¬ 
bility  case  and  extended  to  a  more  general  form 
for  multi-valued  logics.  A  number  of  results  in¬ 
volving  this  general  form  are  presented,  including: 
Justification  for  use  of  expert-derived  Information 
for  Inference  rules  and  other  factors/ tie-ins  with 
plausibility  measures;  characterizations  of  formal 
language  symbolizations  and  related  data  fusion 
results;  and  a  new  approach  to  data  fusion  evalua¬ 
tion  through  algebraic  logic, developing  a  formal 
counterpart  to  conditional  probabil 1t1es-"con- 
ditlonal  objects"for  consistent  manipulation  of 
disparate  data. 

1.  INTRODUCTION 

This  paper,  for  the  most  part,  is  an  abridg¬ 
ment  of  a  much  longer  version  [1  ]. 

for  the  past  several  years,  throughout  many  field; 
oi  science  and  technology,  researchers  have  been  seek¬ 
ing  unification  and  extension  of  past  results  in  order 
to  explain  reality  better  and  to  be  able  to  predict 
future  rieve lopiicr.ts .  Recent  events  in  theoretical 
physics  involving  “superstring"  theory,  an  attempt  at 
developing  a  Grand  Unified  Theory  of  the  Universe, 
underscore  this  quest  [1], 


In  a  mere  modest  way,  this  paper  seeks  to  estab¬ 
lish  a  theory  unifying,  coordinating,  and  extending 
the  somewhat-appearing  distinct  concepts  of  data  fus¬ 
ion,  combination  of  evidence,  and  C3  systems  analysis. 
On  the  other  hand,  relatively  little  attention  will  be 
paid  here  to  detailed  computational  techniques  which 
are  particular  to  certain  types  of  coitmon  data  fusion 
problems  such  jj  regression  procedures  for  combining 
stochastic  sensor  Information,  or  maximum  likelihood 
or  Bayesian  procedures  for  putting  together  geoloca¬ 
tion  data  arriving  from  different  sources  relative 
to  a  given  target  of  Interest.  All  of  the  above-men¬ 
tioned  techniques  are  essentially  special  cases  of 
a  much  more  general  combination  of  evidence  approach, 
on  which  this  paper  will  concentrate. 

Previously,  this  author  proposed  a  bottoms.up, 
microscopic,  quantitative  approach  to  general  CJ  sys¬ 
tems  [4],  In  that  approach,  a  generic  C3  system 

is  identified  as  a  network  of  node  complexes  of  de¬ 
cision-makers,  human  or  automated,  interfacing  with 
each  other  in  general.  Each  node  receives  "signals"- 
which  may  be  ordinary  communication  signals,  either 
from  friendly  or  hostile  sources  (possibly  unaware), 
or  which  may  be  received  weapon  fire.  In  general, 
these  “signals"  are  stacked  vectors  comprised  of  in¬ 
coming  data  from  several  different  nodes.  In  turn, 
each  node-  which  may  consist  of  a  single  decision¬ 
maker  or  some  coalition  of  decis Ion-makers  and  which 
may  Include  passive  type  decision-makers,  such  as 
"followers"  -  then  processes  the  data.  This  Is  follow¬ 
ed  by  a  response  or  action  taken  towards  other  nodes, 
friendly  or  hostile,  (tlj, Figure  1 . 1  Associated  with 
each  node  is  the  node  state  (IT  I, Figure  2.)  describing 
the  Current  state-of-affalrs  given  in  terms  of  a  num¬ 
ber  of  functions  such  as  threat  level,  equations  of 
motion,  and  supply  level.  In  addition,  there  Is  an  as¬ 
sociated  knowledge  base  reflecting  the  node's  local 
knowledge  of  the  other  nodes  (friendly  or  adversary). 
Also  associated  with  each  node  is  its  internal  "signal" 
processing  design,  as  described  in  Figure  3.  There, 
data  fusion  plays  a  central  role  in  transmitting  de¬ 
tected  "signals*  to  hypotheses  formulations,  which  in 
turn  through  algorithm  selection  leads  to  an  output 
response  to  other  nodes  (again,  these  may  be  friendly 
or  adversary)  . 

Next,  since  we  identify  data  fusion  with  the  com¬ 
bining  of  evidence,  all  of  the  knowledge-based  system 
techniques  associated  with  the  latter  are  available. 

In  particular,  this  inters  (see  [5],  Chapters  1,2 
and  Figure  I,  page  14)  that  a  series  of  underlying 
processes  are  involved  in  data  fu.ion.  Basically, 
tr.ere  are  five  such  processes  (including  natural 
language  in  its  broadest  context)  given  in  Figure  1  . 
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Figure  J.  Subprocess  Expansion  of  Data  Fusion/Combination 
of  Evidence  Process  Connecting  Initial  “Signal’ 
Detections  with  Hypotheses  Formulations 
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Figure  1.  Symbolic  Form  for  CJ  Decision  Game 


7.  DATA  FUSION  AS  A  QUANTITATIVE  PART  OF  AN  OVERALL 
C3  SYSTEM  AND  DECISION  GAME 
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r,  in  this  development  toward  a  general 
■  the  fusion  of  data,  only  general  gualita- 
•Iptions  have  teen  given  tor  the  processes 
However,  as  mentioned  before,  a  quanuta- 
for  generic  C3  systems  nas  been  established 
1  with  these  qualitative  formulations 
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N  N  0  D  E  BOUNDARY 

Figure  3.  Data  Fusion  as  an  Integral  Part  of 

Data  Processing  Structure  for  a  Node, 

(D)  ot  Incoming  '‘signals”  ( S ) ;  algorithm  selections 
(f);  Initial  r.oae  responses  (R),  prior  to  environmental 
distortion  (&)  and  additive  noise  ( Q )  ■  To  each  vari¬ 
able  is  affixed  subscripts  (g.k)  (or  (h,g,k))  where 
g-(a  ,1 )  denotes  the  identification  of  a  particular 


node  In  question  In  terms  of  the  system  a  (friend-, 
1y  or  hostile)  end  node  number  1,  while  k  represents 
a  discrete  time  index  t,.  Specifically,  the  relation 
breaks  down  Into  5  Intranodal  (within  nodes)  rela¬ 
tions,  2  Inter  no  dal  (between  nodes)  or  regression  re¬ 
lations,  a«d  3  prior  relations  for  each  C3  system. 
These  relations  are  expressed  in  terms  of  conditional 
ur  unconditional  probabilities,  as  they  stand,  but 
the  CKinU?  can.  bs  cxteadefl .  with  appropriate  replace¬ 
ments,  tn  a  multivalued  logic,  settlnn.  (Again,  see 
[4].)  Then  by  making  certain  reasonable  sufficiency 
assumptions  among  the  variables  and  utilizing  basic 
properties  of  conditional  probabilities,  it  can  be 
shown  that  each  updated  node  state  can  be  obtained 
explicitly  In (probabil Isttc)  terms  of  the  other  vari¬ 
ables  and  node  states  through  PRIM.  Thus,  we  have: 

Theorem  1.  (See  [4],  Theorem  1.) 

Suppose  PRIMk  and  N^  k  are  as  described  above 
with  PRlMfc  given  in  further  details  In  Task  X. 

Then,  under  certain  reasonable  sufficiency 
conditions  [4], 


•  (11) 
where  4  k  is  a  computable  functional  involving  a  fi¬ 
nite  number  of  integrations  and  arithmetic  operations 
upon  the  elements  of  PRIM,  given  In  Table  1. 

_  *  _ ■ 

L  4  ‘■‘V'Yi-W  .  “V..!* 
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**•  «  £  “Vs.im  *  P(V;».S«0  »  I 

_ ,  —  z  *?’fi,9.HI  *  |l*Wj,Ci  *i,Iwq1  • _  TiOl«  a.  i 

The  bask  fntcrnoiMl  Vs  vu  Relative  Primitive  I 

noalinear  re9r«tsion  relation  Relations  for  CJ  I 

. . . 

«r.«r«  variable  V  ,  .  Indicates  original  passible  indicates  nod* 

k  Indicates  time 

Visible  node  source  for  “signal"  at  time  k,  given  |ndti. 

reception  bf  anotner  node  it  k«l .  _ _ 

In  turn,  a  simple  two-person  zero  sum  game  can 
be  established,  called  the  C3  decision  game.  Here. 

Player  I  corresponds  to  entTre  C3  system  a*l  (say, 
friendly)  and  Player  II  corresponds  to  entire  C  sys¬ 
tem  tmZ  (say,  adversary).  In  this  game,  a  move  by 
Player  j  corresponds  to  a  choice  (up  to  given  con¬ 
straints)  of  PRIMP  .J ) ,  J-1,11.  and  the  resulting 
loss  or  utility  due  to  any  such  Joint  move  L.  Is  a 
function  of  the  marginal  updated  node  rtate  distri¬ 
butions,  according  to  Theorem  1  as 

Lk(PRIMk)*M°Ek((p(N|>k)|*11  9)) 

«  H0Ek((^  k(PRIMk))all  g ) ) .  (1J. ) 

where  MOf.  represents  a  single  f  igure-of-rotri  t .  com¬ 
bining  various  measures  of  effectiveness  (roue's)  or 
performance  (mop's)  for  the  two  C-  systems,  (kotc,  that 
although  ideally  the  entire  Joint  node  state  distri¬ 
bution  of  the  two  O  systems  slioulJ  be  sought,  In 
prjctice  this  is  difficult  to  do,  because  of  !‘t  great 
combinatoric  computations  Involved.)  Typical  moe's 


that  could  be  used  include: averaged  measure  of  import¬ 
ance  Tff  .  ;  averaged  measure  of  threat  TIT  .  ;  upper 

A|K  • 

bound  total  entropy  THT^  k  ;  and  averaged  measure  of 
performance  WT^  k  .  all ’computable  through  pCH^_  ^) ' s 

f oi  C3  system  a,  by  use  of  Theorem  1.  (See  also  [*»], 
eqs.(b9)-{6/).)  Then  one  could  let 


«°Ea.k s  V^.k  +  V^.k  +  V^a.k 

+  -  Act  .  .  (■*.+) 

and  the  k.'s  are  some  predetermined  weightings. 

1  3 

Symbol  ically,  the  C  decision  game  appears  as 
given  In  Figure  X, 

Finally,  one  can  then  apply  all  the  usual  game- 
theoretic  methods  to  this  CJ  game,  such  as  seeking 
Bayes  decision  functions  for  moves,  least  favorable 
strategies  (all  subject  to  practical  constraints), 
minimax  strategies,  the  game  value,  and  various  sensi¬ 
tivity  measures.  It  is  the  long-range  hope  that  such 
a  game  will  be  a  useful  decision-aid  In  planning  com¬ 
mand  strategy.  At  present,  a  relatively  simple  Imple¬ 
mentation  scheme  is  being  carried  ou$  for  testing  the 
feasibility  of  such  an  approach  to  C  systems. 


3.  STRUCTURE  FOR  DATA  FUSION:  THE  CLASSICAL 
PROBABILITY  case 

With  the  general  C3  system  context  for  data 
fusion  established  in  the  previous  sections,  let  us 
now  return  to  the  task  of  developing  a  general  quanti¬ 
tative  Structure  for  data  fusion.  In  light  of  the  pre¬ 
vious  remarks  (again,  see  Figure  3),  fusion  is  a  pro¬ 
cess  intermediate  with  initial  sensing  and  hypotheses 
formulations,  within  a  C  node  complex  of  decision¬ 
makers.  In  addition,  the  fusion  process  decomposes  in¬ 
to  natural  subprocesses  (see  Figure  1).  Thus,  In 
essence,  we  wish  to  expand  the  first  relative  primi¬ 
tive  intranodal  relation  appearing  In  Table  1  : 

P(FU)  »  p(H { 0 ,S)  ,  13.’) 

where  for  reasons  of  convenience  from  now  on  we  sup¬ 
press  the  denotlonal- time  indices,  unless  necessary. 

As  stated  before,  p  need  not  necessarily  refer  to  ord- 
Inory  probability  evaluation,  but  may  represent  other 
evaluations  such  as  possibilities  for  Tadeh's  Fuzzy 
Logic  or  for  more  general  multivalued  truth  systems. 

In  determining  the  above  evaluation,  another  var¬ 
iable  1  is  often  present.  1  represents  the  vector  of 
auxiliary  or  “nuisance”  characteristics  or  attributes 
which  can  be  useful  In  connecting  H,  the  variable  rep¬ 
resenting  possible  hypotheses  or  decisions  as  to  what 
unknown  parameter  value  or  situation  or  diagnosis  is 
occurring,  with  input  data  S  and  detection  state  D. 
Thus  for  example,  if  we  are  physically  in  a  bunker- 
d  C3  node-  S  may  be  observed  loud  noise,  with  0*1 
(definitely  detected),  and  H  could  have  possible  do¬ 
main  values  say  dom(ii) *{H^ , . .  ,Hj)  as  given  In  Tab.e 


Hj  •  no  change  in  previous  situation 

H,  *  enemy  is  about  to  mount  the  promised  big 

*  offense 

Hj  *  enemy  is  Just  feeling  us  out 
*  enemy  wants  to  negotiate 

Hj  *  none  of  the  above  situations  ho!d 
Table  3,  Typical  Set  of  Values  for  dom(H). 

Thus.dom(tl)  could  serve  as  a  legimate  sample 
space,  if  conditional  probability  p(HjD.S)  could  be 
obtained  for  all  possible  values  of  H  in  dom(H),  i.e. 
(H|0.S)  could  be  interpreted  as  a  random  variable 
over  dom(H).  In  this  case,  suppose  also  that  Z  is  an 
auxiliary  variable  representing  any  of  a  likewise  col¬ 
lection  of  disjoint  exhaustive  situations  locally  go¬ 
ing  on  at  the  bunker.  Here,let  dom(Z)  be  given  as  in 
Table  be  low : 

2^  *  nothing  happening 

Z.,  *  accidental  explosion  in  compartment  11 

Z^  •  accidental  explosion  in  compartment  12 

Z.  *  enemy  shot  missile  at  us  and  It  either 
hit  us  or  Just  missed 

Z^  »  none  of  the  above  situations  hold 

Table  4.  Typical  Set  of  Values  for  dom(Z). 

Thus,  again  by  disjointness  and  exhaustion,  it 
is  reasonable  to  conclude  that  dom(Z)  could  serve  as 
a  legitimate  sample  space  and  Z  can  be  interpreted  as 
a  random  variable.  All  of  this  leads  to  the  evaluation 
of  the  conditional  probabilities  p(Z|D,S),  which  to¬ 
gether  with  the  values  for  P(H|0,S)  can  be  used  to 
obtain  the  standard  "integrated-out"  form  for  the  post¬ 
erior  distribution  of  H  as  given  below'. 

5 

P(H*H  .  |  U4S  )*■  l  p(H,4Z.|D4S) 

J  1-1  J  1 
5 

-  |  p(Z . j D4S) -p(H  .  1 2 * 4D4S )  ,  (3.2) 

i«l  1  J 

using  the  standard  chaining  property  of  conditional 
probabilities  and  replacing  the  antecedent  comma  no¬ 
tation  by  conjunctions.  One  could  reasonably  interpret 
the  evaluation  In  (3.2)  as  the  probability  value  for 
the  expression 

"If  0  and  S .then  Hj"  (3.3) 

through  the  probability  values  for  the  expressions 

"If.D  and  S,  then  Z/'  and  "If  Z^  and  0  and  S,  then 

(3.4) 

• 

Of  course,  one  need  not  use  the  above  evaluation  ex¬ 
actly  to  obtain  useful  equivalent  values.  As  it  stands, 
P(Z,|04S)  can  be  interpreted  as  an  error  or  variability 
proiabflity  for  attribute  Z,  while  p(Hj|Z,404S)  can  bs 
understood  to  mean  the  inference  rule  proiablllty  con¬ 
necting  7  and  0  and  S  with  H.  On  the  other  hand,  often 
tne  conditional  data  oi  regression  probubil'ty 
P(S|Z(4Hj)  and  the  joint  prior  probability  pU^H^) 


are  available,  assuming  here  D»1 ,  which  by  use  of 
Hayes'  theorem  also  yields  p(H*Hj |04S) .  One  standard 

result  is  U  assume  tl.c  above  probabilities  are 
goussian,  which  In  the  discrete  problem  here,  most 
serve  as  very  rough  approximations-  In  addition,  the 
sets  dom(H)  and  domfZ)  are  not  easily  ordered  com¬ 
patible  with  a  real  domain  for  gaussian  random  var¬ 
iables  .  Then,  if  the  mean  of  the  conditional  data 
distribution  is  linear  in  the  data  S,  p(n.4Z  |S) 
takes  on  a  generalized  weighted  least  squire!  form. 
(See,  e.g.  [6].)  The  final  result,  p(H*Hj|S),  as  in 

(  3.2),  Is  then  a  mixture  of  the  probabilities  of 
such  least  squares  estimators. 


4.  STRUCTURE  FOR  DATA  FUSION:  THE  CLASSICAL 

PROBABILITY  CASE  MODIFIED 

Retaining  the  same  terminology  as  before,  sup¬ 
pose  now  that  H,Z,S  are  variables  such  that  any  of 
the  corresponding  "sample  spaces"  do  not  truly  con¬ 
tain  disjoint  exhaustive  events;  in  particular,  the 
disjointness  condition  may  be  violated  more  often 
than  exhaustiveness-  which  we  will  assume  here  Is 
always  satisfied.  Then  it  follows  that  simple  cor¬ 
responding  probability  measures  as  in  Section  4  can¬ 
not  be  immediately  assigned.  Nor  should  "brute- 
force"  normalization  procedures  be  employed,  unless 
absolutely  necessary.  For  example,  consider  H.  Sup¬ 
pose  in  the  above  example  In  Section  3  (Table  3),  the 
enemy  could  simul taneously  mount  the  promised  offense 
(Up),  yet  also  be  feeling  us  out  for  peace  (H.),  or. 
even  additionally,  wanting  to  negotiate  (H  ) .  Thus,  in 
that  case,  dom(H) “{H. , . .  ,H,  ) ,  as  it  stands,  is  oal  a 
suitable  sample  spaci  of  disjoint  elementary  events. 
Indeed,  the  elementary  events  H,  are  not  so  element¬ 
ary,  many  of  them,  due  to  complex  causes,  being  over¬ 
lapping!  Equivalently,  H  In  Its  current  form  may  not 
be  a  legitimate  random  variable.  What  to  do? 

In  particular,  consider  the  crucial  expression  q 
for  data  fusion  appearing  as  primitive  intranodal  re¬ 
lation  (1)  in  Table  a,  sans  the  probability  evalua¬ 
tion, and  In  natural  language  form: 

ft  Si  "If  D  4  S,  then  H".  (4.1) 

In  Symbolic  form,  where  •  represents  4,  y  repre¬ 
sents  "or",  (  )'  represents  "not",  *  represents  Impli¬ 
cation, 

£)  *(D-S  3  H).  (4.2) 

Theorem  3.  (Serf  111  , Theorem  4»J 

Suppose  a  formal  language  of  proposi  tions  satis¬ 
fies  constraints  (a )  ,(b)  ,(c) , (d).  Suppose  also  that 
variables  D , S ,11 , Z  are  to  be  Interpreted  as  before  in 
the  general  sense  and  are  such  that  (i)  and  (11)  are 
satisfied* ,  where  constraints  (*)  are  given  in 
[1  3,  Section  6.  Then: 


t(  Z,  ;0,S  ;H) , 


Zj  t  dcavZ) 
where  for  all  Z .  in  dcm(Z) , 


i(2j ;D,S ; M )  °  (0-S  3  21  *H) 


(4.3  ) 


d(Z,  ;D.Si -.D.s).  (4.4) 


g(z, ;D.s) 


[0-S  3  2,3 


,  I'.TiVal 


c«n  be  Interpreted  is  in  attribute  variabi 1 i ty  or 
error  form  and 


MH-.Zj-.O.S)  »  {Z(-D-S  3  H) 


(4 .6  ) 


can  be  interpreted  as  an  inference  rule  connecting  Z, 
and  H.  ’ 

■ 

Given  variables  D,S,H  and  auxiliary  variable  ZJ 
Next,  for  convenience  define  for  all  1,J 

a  -  (D-S  3  Z)  ;  a,  ^  (D-S  3  Z,)  ;  (4.7  ) 

0  d(Z-D*S  3  H)  ;  6jj  ^  (Zj*0*S  3  Hj) .  (4.8) 

dom(a)  -  1 1 1 1 )  •••  dom(Z)  -  (ZjicI),  (4,4  ) 

do"(fl)  *  (Bjjliel.jeJ)  dom(Z)xdom(H) 

“  UZj.HjJllcl.jtJ),  (4.10) 

AJ  ^  Ua,.en)|icU-((Z  Z  H.)|1et>. 

J  J  '  1  J  (4.11) 

Theorem  3.([S],  Chapter  5)  (SevstlJ/rbc'ciVin  5.3 

trt  poss  :dom(  )  ■*  [0,1]  be.  any  function,  perhaps 
representing  the  expert  opinions  of  a  panel,  as  human 
integrators  of  information,  taking  into  account  the 

complex  and  possible  overlapping  natures  of  the 
events  In  dom(  ), 

Then  make  the  following  semantic  evaluation  of  (J 
preserving  the  formal  structure  In  Theorem  a: 

poss(5  ■  Qj)  »  poss ( 0  -  (0-S  3  Hj)) 


♦or**i(poSSa(al),pOSSfl(8iJ^- 


poss(d-dj)  •  poss (  Aj  n(Sa  *  Sjj)  f  0  ) 
•  p(  Aj  n(SQ  *  SJ/  0  ) 


p1ausS  »  S  (Aj}  * 
a  e 


(4,12  ) 


(4.13) 


where  plius^  x  $  denotes  the  plausibi 1 1 ty  or  upper 
a  0 

probability  measure  with  respect  to  random  subset 
Sfl  of  dom(a}*dom(0) . 

Remarks . 

For  related  results,  see  the  multivalued  * 
logic  and  fuzzy  set  approach  to  correlation  and 
tracking  through  the  PACT  algorithm  [3  ].  For 
general  background,  see  [5],Ch.  3,4.  Shafer  [7] 
developed  use  of  plausibility  measures  and  other  bl- 
jectively  related  functions,  such  as  "belief"  and 
"doubt"  measures  in  modeling  combination  of  evidence 
problems.  However,  Nguyen  [U]  has  emphasized,  via 
Choquet’s  Capacity  Theoreir^which  characterizes  such 
functions  in  terms  of  both  their  random  set  connect¬ 
ions  and  their  generalized  PotncarF  expansion  forms, 
that  such  "measures"  require  fu)J  specification  of 
the  associated  nndom  (sub)sets. 

5,  STRUCTURE  FOR  OATA  FUSION :  THE  GENERAL 
COm  I  NATION  OF  EVIDENCE  CASE 

Let  us  return  to  the  formal  language  aspect  of 
data  fusion  as  given  in  Theorem  3.  In  general  know¬ 


ledge-based  sys  terns ,such  as  medical  diagnosis  ones., 
consist  of  a  collection  of  inference  rules  corres¬ 
ponding  to  h(ll,Z.;0,S)  linking  e'-.ner  observed  data, 
such  as  D,S  or  portions  of  intermediate  variable  Z 
with  other  portions  of  Z  or  with  diagnoses  directly, 
played  by  the  role  of  variable  H.  Similar  comments 
hold  for  the  attribute  variability  term  g(Z(iO,S). 

The  somewhat  similar,  but  more  general  structure 
for  such  systems  is  given  as 

m  (5.D 

Q,  d  v  (  •  U.(Z..H,|r),S)3fe.(Z  H.jD.SD) 

k-1  v  i  ' J - -  ui — LJ - 


Z1  c  doro(Z) 


*iMJ  .  Pfiki j 

representing  (D-S  3  H),  where  for  all  k,  and  fej, 

■Are  .possibly  expert. derived,  boolean  functions  ,i.e., 
combinations  of  operations  •  ,  v  ,  (  )'. 

Next,  to  complete  the  general  data  fusion  theory 
again  referring  tu  Figure  1,  we  must  choose  an  ALDP, 
l.e.,  a  pair  consisting  of  a  compatible  choice  of 
formal  language  followed  by  a  semantic  evaluation  or 
logic . 

Consider  then  as  reasonable  candidates  for  the 
evaluation  of  (5.1), ALDP  1,2,3  as  In  Figure  1. 

Again,  it  can  be  shown  quite  readily  the  first  3 
ALDP  examples  in  Figure  1  are  surh  that  t.heir  formal 
language  components  satisfy  (a  )-(d) .Theorem  2  ,  when 
implication  is  Interpreted  as 

3  *  ■*  ,  (5.1  ) 

where  for  all  o.s 

(0  a)  «(0‘  v  a) .  (5,3  3 

Details  of  these  evaluations  are  g^ven  In  [  1  ] 
Section  7.  However,  for  fixed  antecedents.  It  Is 
seen  there  that  negation  and  disjoint  union «■)  fail 
in  all  of  these  ALDP's  to  yield  hor.omorplmms ,  but 
ALDP  4(  to  be  explained  In  the  next  section)  does  po- 
sess  this  property-  indeed  it  Is  a  characterizing 
relation . 

Consider  next  5 

p(0Q  3ao)  •  p(0'  v  aj  -  l-p((B’vao)')*  l-Pfe^) 

■  p(“0|e0)  ♦  P(%le0)  -  P(V°o> 

*  p(o0IV  *  PK^o*  '  p(o0|80),plfi0) 


-  P(ao|0o)  +  P(a' |0O)-P(0') 

*  P(°0|B0) 

*  p(<vV  • 


(5.4) 
15.5  ) 


where  the  conditional  probability  is  defined  as  usual 
as ,  e.g. , 

p(“0!»o)  *  p<V*oj/p(V*  (5-C) 

provided  p(0Q)  >  0. 

The  above  inequalities  are  strict, in  general  .and 
show  tha t , bas ic a  11 y ,  we  cannot  identify  implication, 
as  defined  in  tne  formal  language  (d)  via  eg. (5. 7  ), 
with  a  "conditional  object"  such  as  (a  |fl  ),  otherwise 
this  would,  following  evaluations  by  p°an8  making  the 
na  :  ura 1  (dent  I f I ca  t Ion 


p((°0|eo))  ■  pU0le0)  .  (S.  7  ) 

contradict  the  inequality  In  (5.4).  Hence  the  behavior 
of  conditional  probabilities,  while  roughly  resembling 
that  of  the  probability  of  implications  is  not  the 
same  -  indeed,  one  can,  by  choosing  Judiciously  d 
close  to  0  in  some  natural  sense,  make  p(ti03  oD)  0 
approach  unity,  while  for  the  same  choice  of  a0,fiOl 
P 'J#l®o  4PPro*cb*s  zero.  The  significance  of  these 

results  will  be  explored  further  in  the  next  section, 
where  we  develop  an  ALOP  (4)  where  formal  implications 
°o4  So  —  **  with  "conditional  objects" 

(ajd  ).  whose  semantic  evaluations  as  in  ( 5.7  )  are 

conditional  probabilities;  hut  in  light  of  the  above 
remarks,  necessarily  these  entities  lie  outside  of  the 
original  space  of  propos ftions  n. 


6.  DATA  FUSION  AND  CONDITIONAL  OBJECTS 

In  Section  5,  we  have  seen  how  a  general  infer¬ 
ence  rule  structure  for  data  fusion  can  be  evaluated 
through  three  different  approaches  ALDP  1-3.  In  all  of 
these,  the  key  connector  for  Inference  3  was  Inter¬ 
preted  in  the  formal  language  components  as  •*  as 
given  in  eq.(5,3  ).  On  the  other  hand  a  natural  -  and 
commonly  used  -  semantic  evaluation  for  inference 
rules  is  through  conditional  probabilities.  That  is, 
the  evaluation  of  a  typical  form  (Jk)j  ^  fe^j) 

P(^k1j lJki j^  for  some  choice  of  probability  measure 

p  over  ft,  the  set  of  all  events  or  propositions,  which 
for  purposes  of  simplicity,  from  now  on  is  assumed  to 
be  a  boolean  algebra.  With  this  choice  of  evaluation, 
apropos  to  the  spirit  of  this  paper,  we  seek  a  formal 
language  which  will  be  compatible  with  these  evalua¬ 
tions,  i.e.,  will  form  an  ALDP. 

However,  as  pointed  out  in  the  discussion  In  the 
previous  section  centered  around  (5,4),  one  cannot 
identify  implication  via  (5.2  )  with  conditioning 
as  evaluated  in  (5.7  ).  The  apparently  commonly-held 
belief  that  such  an  Identification  can  be  made  with 
no  serious  consequences,  often  called  In  the  litera¬ 
ture  of  logic  as  Stalnaker's  Thesis  [7],  was  attacked 
by  Lewis  [10]  and  Independently  by  Calabrese  [ll  ] .  The 
latter  Indeed  showed, by  use  of  a  simple  canonical  ex¬ 
pansion,  that  not  only  •*  in  (5.2  }  would  not  work, 
but  any  boolean  function  of  two  variables  could  not  be 
used  to  play  the  role  of  conditioning,  compatible 
with  conditional  probability  evaluations. 

Moreover,  It  would  be  particularly  desirable,  to 
replace  this  rather  flawed  situation,  with  an  ALOP 
which  would  yield  feasible  computations  for  data 
fusion  or  at  least  be  on  the  same  order  of  complexity 
as  ALDP  1.2,3.  Note  of  course,  if  truly  all  inference 
rule  antecedents  are  identical,  as  Is  the  case  es¬ 
sentially  in  Section*  3,4  ,  then  there  Is  no  real 
need  to  work  with  conditional  objects,  since  all  con¬ 
ditioned  events  car  he  simply  considered  as  uncon¬ 
ditional  ones  relative  to  their  intersections  with  the 
fixed  common  antecedent,  or  one  can  stick  with  the 
interpretation  of  implication  as  in  (5.2  J .  (Compatible 
with  this  result  ,  note  the  homomorphic  relations 
for  implication  w.r.t.  disjunction  and  conjunction 
-  but  not  negation  -  as  given  In  eqs.(7.4)f  (2.5)  of  El  1.) 


simplification  occurs  ano  the  development  of  such  con¬ 
ditional  objects  would  address  the  problem.  Although 
we  have  stated  above  that  Implication  operator  -*  for 
a  fixed  antecedent  yields  homomorphic  relations  for 
v,J,  but  not  (  )',  conditional  probabilities  are  com¬ 
patible  with  homomorphic  relations  holding  for  all 
three  operations,  for  any  fixed  antecedent',!  .e  ~ 5b- 
vtously,  for  all  a  ,0  ,T  c  G  , 


P((“0lTo),)  *  1  *  P^o^o1  *  pKI*0).  (6 •  1 ) 

p((a0!r0)  V  («0Iy0))  -  p(aQV  B0|y0)  .  (fa. 2) 

P((ao!Y0)-(fl0lYo))  "  P(“o‘0oIyo)  •  (6.3) 

Recall  also  the  operation  +  over  n  ,  which  in 
terns  of  v,  •,  (  )'  Is  ,  for  any  o  ,6  c  n 


a  ♦ 
0 

V 

a  v 

0  0 

a  ' 4 1  , 

o  o’ 

(6.4) 

*r,d  conversely, 

a  v 

0 

8o  ■ 

1  a  ♦  t  + 
0  0 

o 

o 

JX> 

o 

(6.5) 

a’  * 
0 

a  ♦  1  . 

0 

(b  .61 

Noting  that  a 

Iso, 

for  any 

a  ,fl  c  a, 

G  O  * 

p (a  I B  )  »  p(a  •  6  IB  )  , 

r  a 1  o  ooo 


the  next  result  shows  that  under  quite  mild  and  sir.iple 
conditions,  conditional  objects  are  essentially  char¬ 
acterized: 


Theorem  4- 


Characterization  of  conditional  objects 

fjy 


Given  boolean  ring  fi,  there  is  a  unique  space 
fl  of  smallest  possible  classes  -  according  to  subset 
partial  orderlng-danoted  es  the  conditional  objects 

(“o'V  *  (UV-  (W . 

.  .  c  n  .  such  that  the  measure-free  counterparts  of 
(fa. 1 )- (6 . 3)  and  (6.8)  hold.  That  Is, 


(v 

IV 

W  * 
v  * 

KV  • 

{V  W* 

(6.5) 

(6.10) 

( a  ! 

Iy  ) 

•  (8JyJ  • 

(a. •  s  lr  ), 

(6.11) 

0 

1  0 

0  1  0 

O 

o 

o 

anc  equivalent 

to 

,  one  can  require 

eqs  . 

(6.11)  and 

(ao 

IV 

*  * 

(V  W 

(6.12! 

to  hold;  and 

(°0iV  * 

[a  •>  |y  )  . 

k  0  lo 1  V 

(6.13) 

Specifically,  such  conditional  objects  consti¬ 
tute  all  possible  principal  Ideal  cosets  of  ring  .3, 

wh<"e  for  any  a  ,y.  c  fl, 

0  0 


*  ^O  *  3  a 


“  l.‘  V 

0 


‘‘•>0  v  VYo 


Ml*  «: 
o 


(6.1-5; 


•:oset  generated  with  resl- 


But,ior  the  modeling  of  data  fusion  threugh  In¬ 
ference  rules  with  varying  antecedents,  no  such  direct 


the  prlnc'pa' 


due  a., 
o 

Proof :  Use  first  the  basic  homomorphism  theorem  for 
quotient  rings  and  the  equivalence  class  property 
of  cosets  applied  to  (£.13).  Again,  see  [12]. 

■ 

For  a  history  of  previous  work  In  this  area, 
see  [  1  ],  Section  8. 

In  the  approach  taken  here,  developing  tij  re- 
sul ts  from  first  principles  considerations ,  the  re  - 
qulred  operations  upon  conditional  objects  are  defin¬ 
ed  simply  as  the  natural  class  nr  component-wise  ex¬ 
tensions  of  the  original  operations.  Thus,  for  exam¬ 
ple, let  °0>60.T0.S0  c  fl  arbitrary.  The  natural  class 

extension  of  •  applied  now  to  (°0|80)  •  (r0l40).  not¬ 
ing  each  conditional  object  Is  In  reality  via  (£.14) 
a  subset  of  n,  yields: 

Uole0)  *  (t0I«0>  •  <q  •  r|qe(a0|60)  .re(y0|60) ) 

*  +  °0)*(i"4o  +  Y^lvcnl 

c  fi.  (£.15) 

The  basic  structure  of  the  conditional  object 
extension  5  of  n  Is  summarized  next. 

Theorem  5  .  Basic  structure  of  0  [12], [13], [1+]. 

(I)  In  terms  of  quotient  rings, 

n  •  u(n/n*5r')»  u (ii/n •■».)•  (£.16) 

Vn  Vn 

(II)  Conditioning  as  defined  here  can  be  Identified 
essentially  as  the  functional  inverse  of  one-sided 
conjunction, 1  .e. ,  conditional  objects  (“qIttq)  *11  **t 

isfy  the  basic  relation  analogous  to  (5.6)  for 
conditional  probabilities  and  a  related  condition: 


'  VYo 

(6.17) 

( «o  1 Y0 1  c  n*  x*Yo  *  Vy0K 

(6.18) 

(ill)  The  natural  class  extensions  of  all  boolean 
operations  from  n  to  fl  are  well-defined/closed  with 
ring-like  properties .1 .e. ,  In  the  same  previous 
sense,  D  Is  a  modified  boolean  algebra. 

( iv)  n  s  5  , 

sfnee  for  all  «0  c  n,  (£.14)  shows  immediately  that 
(o0|l )  »{a0)  .  (6.19) 

(v)  Also,  partial  order  s  defined  over  ft,  character 
Ized  by  ,  for  any  ofl  ,  tQ  e  r«, 

o  S  8  Iff  an  •  0  *8.  Iff  B.  -  8.  v  a  ,(6.20) 
00  000  000 

can  be  extended  directly  to  fl  with  the  same  charac¬ 
terizations  as  In  (6.20)  where(uncond1 tlonal )  ob¬ 
jects  In  fl  are  replaced  by  conditional  ones  in  fl, 
Then.comblnlng  this  with  (ill)  and  (iv)  establishes 
(fi,v,",(  )’,♦;*}  as  a  natural  extension  of  Its 
unconditional  counterpart  (fl,v,*,(  )’,+;*). 

(vl)  A  basic  calulus  of  operations  Is  ,  In  addition 
tu  the  properties  In  (6.9)-(6.13)  for  any  “j.r,  c  fl, 
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(6.23) 


Noting  the  reductions  of  (6.21  )-(6.23)  when 

antecedent  Y,***'*Y»*Y  .  as  in  (6.9)-(6.12) ,  It 

•  mo 

follows  that  all  boolean  operational  extensions 
over  fl  coincide  with  corresponding  coset  operations 
when  restricted  to  a  fixed  quotient  ring,  here 

fl/n-y;  • 


( v  1 1 )  As  a  special  case  of  (£.22),  the  following 
chaining  condition  holds  for  all  “0»B0.Y0  e  n  : 

(VjoIyo)  ‘  ^olV'K^o’V-  (6'-Z4) 


Proof:  The  most  difficult  proof  is  that  of  (6.22). 

A  sketch  of  the  proof  for  the  case  m=2  is  given  In 
[13],  Theorem  3.1,  a  full  proof  Is  presented  1r  [T2] 
where  all  other  proofs  are  also  given. 


Remarks . 

Apropos  to  Theorem  5(1),  It  follows  that  all 
results  in  the  theury  and  application  of  linear 
(w.r.t.  •  over  v)  boolean  equations,  such  as  pre¬ 
sented  In  [15], can  be  reinterpmted  in  terms  of  con¬ 
ditional  objects.  Extensions  of  the  concept  of  con¬ 
ditioning  to  more  general  structures  than  boolean, 
such  as  modified  boolean, or  Von  Neumann  regular,  or 
to  a  category  theory  setting, have  been  considered 
[12]. 


Many  other  mathematical  properties  have  been 
derived  for  conditional  objects,  l/icluding:  char¬ 
acter!  za  tions  for  Iterated  conditional  objects, 1  .e. , 
conditional  objects  whose  antecedent  and  consequence 
are  also  conditional  objects;  extensions  of  Stone's 
Representation  Theorem  to  conditional  objects;  de¬ 
velopment  of  an  outer  approximation  technique  to 
force  closure  for  non-boolean  functions.  Including 
arithmetic  operations  over  conditional  objects;  rela¬ 
tions  established  between  ordinary  conditional  random 
variables  and  a  randomized  version  of  conditional  ob¬ 
jects;  and  establishment  of  various  probabilistic 
connections.  Such  as  measure-free  Independence;  meas- 
ure-free  bayesian  and  sequential  learning  forms;  and 
the  proof  that  the  extension  of  any  probability 
measure  p:fl  -»  [0,1]  to  p:fl  ♦  [0,1]  through  eq.(5.7  ) 
yields  for  the  extension  a  monotone  function. (  Again, 
see  [12]-[l+],  for  further  details.) 

Most  Importantly  here,  analogues  of  calculus  of 
relations  for  AIDP  1  (111 ,  (7.2}-(7.7) )  hold  for  con¬ 
ditional  objects,  as  Theorem  5  shows.  Moreover,  tne 
hypotheses  for  Theorem  1  all  hold  here.  At  this  point 
let  us  define  AIDP  4,  for  a  given  boolean  algebra  fl 
as  simply 


ALDP  4  =  (n.p) ,  (6.25) 

where  p:fl  -  [0,1]  is  the  conditional  probability  ex¬ 
tension  of  p.-fl  -•  [0,1],  as  mentioned  above  and  where 
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all  o0.a0  c  n  , 


(B0  3  a  )  •  (a  IbJ. 


(6.26) 


(Note  that  Implication  or  conditioning  here  Is  re¬ 
stricted  to  be  upon  unconditional  elements,  l.e.  el¬ 
ements  of  o,  not  upon  other  properly  conditional  ob¬ 
jects.  Some  results  Indicate  a  possible  Identification 
of  Iterated  conditional  forms  with  simple  conditional 
objects (i.14], Section  4)  so  that  In  a  sense  this  rep 
strlctton  may  be  unnecessary.) 

Finally,  consider  use  of  ALDP  4  In  evaluating 
data  fusion  expression  Q  In  (5.1): 

Direct  use  of  (6.21)  and  (6.22)  show  that 

*  P<  v  (  *  (kklfUkfj)  )  ) 

J  Zfe  dom(Z)  k-1 

-  p(*fHj ;D.S) JaCHj ;0,S)vfl(HJ ;0.S) ) 

*  platH^D.SiJ/ptalHj-.O.SJvglH^O.S)). 

(6.27) 


A  m  m 

g(H.;0,S)  *  •  (  v(fckii*4lPv  *  4(1  J 

J  Z.c  dom(Z)  k-1  k,J  k1J  h-1  k,J 

1  (6-16) 

v:  i,z,  «•«> 


Thus,  due  to  the  calculus  of  operations  given  In 
Theorems,  computations  for  data  fusion  using  ALDP  4, 
W!*tv  Implication  interpreted  as  a  candl tlonlng, com¬ 
patible  with  conditional  probabilities,  appears  no 
more  complex  than  that  for  the  other  choices  of  ALOP's. 

7.  SUMMARY  AND  FUTURE  DIRECTIONS 

Because  obviously  C*  systems  are  large  scale 
ones,  relatively  few  attempts  have  been  made  at  ap¬ 
proaching  such  systems  from  the  viewpoint  presented 
.h  this  paper:  a  microscopic  bottom's  up  approach 
Indeed,  the  system  branching  problem  is  so  formid¬ 
able,  that  for  any  realistic  Implementation,  prun¬ 
ing  techniques  are  necessary  at  all  stages  of  model¬ 
ing.  However,  this  should  not  preclude  anyone  -  if 
even  naively  -  from  attempting  a  first  cut,  first- 
principles  approach,  without  any  such  abridgment. 
Such  a  theoretical  structure  can  serve  as  a  common 
framework  or  language  for  comparing  and  contrasting 
entire  or  parts  of  CJ  "theories".  Furthermore,  this 
generic  model  could  be  useful  in  rlgorlting  overall 
C3  activities  within  a  unified  framework  and  pro¬ 
vide  Insights  not  available  from  a  situatlon-spe- 
sific  or  only  local  level.  In  a  similar  vein,  data 
fusion  is  considered  here  as  an  Integral  part  of  a 
larger  C3  structure  and  Identified  with  the  com¬ 
bination  of  evidence  problem. 

As  for  future  directions,  further  work  must 
be  done  In  Integrating  the  cognitive  process  phase 
with  the  full  semantic  evaluation  carried  out  for 
choice  of  an  ALDP.  This  should  include  mental  im¬ 
aging  and  related  thought  processes.  Alternative 
data  fusion  structures  .such  as  recursive  forms  anal  ¬ 
ogous  to  Kalman  filter  forms,  will  also  be  consid¬ 
ered.  Tie-Ins  with  proposed  m.-.croscopic  C3  models 
have  yet  to  be  carried  out. 
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